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Digital image data which has been compressed 
in accordance with the MPEG system and corrected for 
aspect ratio is multiplexed with correction data 
provided as PSM data for correcting the aspect ratio of 
such digital image data in the letterbox mode, squeeze 
mode or the like. The PSM data is detected from the 
bit stream by a PSM detector and a control signal is 
generated in response to the detected PSM data for 
controlling filters of a display so that the latter 
displays an image in the correction state. 
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(57) Abrege/Abstract: 

Digital image data which has been compressed in accordance with the MPEG system and corrected for aspect ratio is multiplexed 
with correction data provided as PSM data for correcting the aspect ratio of such digital image data in the letterbox mode, squeeze 
mode or the like. The PSM data is detected from the bit stream by a PSM detector and a control signal is generated in response to 
the detected PSM data for controlling filters of a display so that the latter displays an image in the correction state. 
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Afrstraqt of the Disclosure 



Digital image data which has been compressed in accordance with the 
MPEG system and corrected for aspect ratio is multiplexed with correction data 
provided as PSM data for correcting the aspect ratio of such digital image data in 
the letterbox mode, squeeze mode or the like. The PSM data is detected from the 
bit stream by a PSM detector and a control signal is generated in response to the 
detected PSM data for controlling filters of a display so that the latter displays an 
image in the correction state. 
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Title Qt tilt Invention 

APPARATUS AND MgPHODS FOR MOT/TIPLEXTNG . 
recording Awr> oo»rrpnT. T ,iflg THK PIS??** Of IMAGE DATA. 
AND RECORDING BEDIM THEREFOR 

BflcKgrounfl at tttt Invention 

This invention relates generally to image data 
multiplexing, recording end display control apparatus and methods 
and an image data recording medium, and more particularly is 
directed to such apparatus , methods and a recording medium 
arranged so as to be able to display at correct aspect ratio 
image data produced, recorded and transmitted with different 
aspect ratios. 

Television is broadcast in Japan, the United 
States and elsewhere using the so-called NTSC standard, for which 
an aspect ratio of 4:3 is established. For this reason, 
conventional display equipment, such as television receivers and 
monitors, mostly have their aspect ratios fixed at 4:3. However, 
with the recent increase in high quality or definition television 
broadcasts, typified by HiVision, which employ an aspect ratio of 
16:9, television receivers with the wider aspect ratio of 16:9, 
the so-called wide screen televisions, are becoming increasingly 
popular. 

As a result, the Image sources that are produced 
and broadcast are also tending to have the wider 16:9 or other- 
aspect ratios. 
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Imago data for display on a screen having this 

16:9 or 

other wider aspect ratio may undergo a change or correction of 
the aspect ratio prior to transmission, so that it can be shown 
on displays with a 4:3 aspect ratio. 

For example. Fig. IX shows a screen with a 4:3 
aspect ratio. Image data intended for display on this screen is 
transmitted without alteration and, of course, can be displayed 
as received. However , in comparison, image data for a screen 
with a 14:9 aspect ratio is transmitted in the so-called 
letterbox mode, as shown in Fig. IB, that is, is transmitted 
after dark or non-image portions are added above and below the 
active image region to provide an overall aspect ratio of 4:3. 
Alternatively, image data for a screen with a 14:9 aspect ratio 
may be compressed in the horizontal direction of the screen in 
the so-called squeeze mode, as shown in Fig- IE, whereby it is 
converted to image data for a" 4:3 aspect .ratio screen before 
being transmitted. 

Moreover, image data for a screen with a 16:9 
aspect ratio may be transmitted in the letterbox mode, as shown 
in Fig. 1C, that is, after dark or non-image portions are added 
above and below the active image region having the aspect ratio 
of 16:9 to provide an overall aspect ratio of 4:3 for broadcast. 
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The dark portions in this caeo are wider than in the case of the 
image data for a screen of 14:9 aspect ratio as in Fig. IB- 
Alternative ly t imago data for a screen with a 16:9 
aspect ratio can be transmitted in the squeeze mode whereby the 
image is compressed in the horizontal direction so as to become a 
4:3 aspect ratio screen, as shown in Fig. IF. 

Image data for a Cinemascope screen with 
approximately a 2:1 aspect ratio may be transmitted in the 
letterbox mode, as shown in Fig. ID, with even wider dark or non- 
image portions added above and below the active image region than 
is the case for the screen shown in Pig. 1C with a 16:9 aspect 
ratio, before being transmitted so that the received signal can 
be displayed on a screen with an aspect ratio of 4:3. 

Furthermore, image data for a cinemascope screen 
with an approximately 2:1 aspect ratio, even if compressed in a 
squeeze mode in the horizontal direction with a compression ratio 
converting it from 2:1 to 4:3, has additional dark portions added 
above and below the active image region after the compression in 
the horizontal direction since it cannot otherwise be fitted to 
the 4:3 aspect ratio . of the screen on which it is to be 
displayed, as shown in Fig. 1G. The images shown in Figs. 1A- 
1C, respectively, can be received and displayed without further 
adjustment on displays having a 4:3 aspect ratio. 
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On the other hand, a display or television 
receiver or monitor SO with a screen having a 16:9 aspect ratio 
may be comprised as shown In Pig. 2. Video signals input via an 
antenna, cable or the like, after demodulation in a TV signal 
demodulator circuit 81, are output for display to a CRT 85 having 
a 16s9 aspect ratio through a controllable horizontal filter 82 
and a controllable vertical filter 83. in accordance with 
instructions from the viewer provided by. means of a remote 
controller or the like (not shown] , a controller 84 is made to 
suitably operate horizontal filter 82 or vertical filter 83. 

More specifically, as shown in Fig. 3 A, for 
example , when received images with a standard 4:3 aspect ratio 
(normal images) are demodulated and output from television signal 
demodulator circuit 81, the viewer uses the remote control to 
switch on horizontal filter 82 and to switch off vertical filter 
83. By this means, on CRT 85 having a 16:9 aspect ratio, as 
shown in Fig. 3D, dark or non-image portions are added to the 
display at the left and right-hand sides of the active Image 
region having a 4:3 aspect ratio. 

When data transmitted in the letterbox mode with 
the overall aspect ratio of 4 = 3, as shown in Fig. 3B, is provided 
as the video input in Fig. 2, the viewer ubbb the remote control 
to switch off horizontal filter 82 and switch on vertical filter 
83. At this time, vertical filter 83 performs a process whereby 
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it reaovii the dark portions added above and below the active 
image region and select* only the active image region having* for 
example, the original aspect ratio of 16:9. By this means, image 
data having a 16:9 aspect ratio can he normally displayed on CRT 
85 as shown in Fig. 3E. 

On the other hand, as shown in Fig. 3C, where 
images processed in the squeeze mode are transmitted with the 4:3 
aspect ratio, the viewer uses the remote control to switch off 
both horizontal filter 82 and vertical filter 83. As a result, 
an active image region with a 16s9 aspect ratio is normally 
displayed on CRT 85, as shown in Fig. 3F. 

The manual switching of horizontal filter 82 and 
vertical filter 83 in this way is relatively Inefficient. 
Therefore* there are some television sets where, for example, 
correction data corresponding to the corrections, if any, to be 
made in the aspect ratio are transmitted during the vertical 
blanking interval of the television signal being transmitted, and 
such correction data are separated out in television signal 
demodulation circuit 81 and output to controller 84 for 
automatically controlling filters 82 and 83, as required. 

In such case, controller 84 controls horizontal 
filter 82 and vertical filter 83 not only in response to user 
Instructions from the remote controller but also in response to 
signals from television signal demodulator circuit 81. Xn this 
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vay. the viewer no longer na.cs to always effect manual control. 
and efficiency of the operation ia improved. 

Howe ver, the insertion of thi- kind of correction 
data into a apecifio lina during the vertical blanking intervaX 
cnnot be employed where the image tren^tted or recorded nam 
b.en digitized, m othar word-, where a video signal is 
digitized for transmission, since data in the vertical blanking 
interval are in effect mostly useless, the specification for such 
digitizing stipulate- that data in the vertical blanKing interval 
are not transmitted or recorded. A- a result, even if correction 
data is inserted within the vertical blanking interval, this 
correction data ia eliminated prior to transmiseion or recording 

if the data is digitized- 

Furthermore, there are three potential variations 
for insertion of the dark or non-image portions in the letterbox 
mode, particularly in respect to the positions thereof relative 
to the active image region. For example as shown in Fig. 4A, the 
active image region may be positioned in the middle, that Is, 
vertically centered between two dark portions; at the top, that 
is, above a single dark-portion, as on Fig. 4B; or at the bottom, 
that is, below a single dark-portion, as in Fig. 4C. 

Moreover, screens may be provided with subtitles, 
logos, symbole and the like, at various locations in respect to 
the active image region in the letterbox mode shown in Fig. 5A- 
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For example, subtitling (ABC) nay be ovtrlayed and positioned in 
the active image region as ahown in Pig, SB, or the subtitling 
may be positioned in one or the other of the dark portions, as 
shown in Fig. 5C. Moreover, as shown in Fig. 5D f there nay be 
multiple superimposed displays in the dark portions in the form 
of not only subtitles, but also logos, symbols, marks and other 
types of patterns. 

Since the data for indicating the various display 
positions of the active image region, as in Figs. 4A-4C, and for 
indicating the display positions of subtitles, logos, symbols and 
the like, are arranged to be transmitted in analog broadcasts by 
insertion in a specified line in the vertical blanking interval, 
this data also cannot be used when the image data is transmitted 
or recorded in digital format in which case, in the course of 
compression, the data in the vertical blanking intervals are 
eliminated • 

otHects and Summary of the Invention 
Accordingly, it is generally an object of the 
present invention to avoid the previously mentioned disadvantages 
of the prior art. 

More particularly, it is an object of the present 
Invention to permit a video signal transmitted or recorded and 
reproduced In one aspect ratio to be automatically corrected for 
display by a television receiver or monitor having a screen with 
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a different: aspect ratio even when the video signal ie 
transmitted and/ or recorded in digital format. 

In accordance with an aspect of the invention, an 
image data multiplexing device comprises means which supplies 
digital image data which has been compressed and corrected for 
aspect ratio, for example, as in the letterbox or squeeze mode, 
means for generating correction data for further correcting the 
aspect ratio of the digital image data, and means for 
multiplexing the digital image data and the correction data from 
said means for generating. 

According to another aspect of the invention, an 
image data multiplexing method comprises the steps of supplying 
digital image data which has been compressed and corrected for 
aspect ratio, as in the letterbox or squeeze mode, generating 
correction data for further correcting the aspect ratio of the 
digital image data, and multiplexing the digital image data and 
the correction data. 

According to another aspect of the invention, an 
image data recording device comprises means which supplies 
digital image data which has been compressed and corrected for 
aspect ratio, as in the letterbox or squeeze mode, means for 
generating correction data for further correcting th« aspect 
ratio of the digital image data, means for multiplexing the 
digital image data and the correction data from the means for 
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generating, and means for recording on a recording medium the 
data multiplexed by the means for multiplexing • 

In accordance with still another aspect of the 
invention , an image data recording method comprises the steps of 
supplying digital image data which has been compressed and 
corrected for aspect ratio, as in the letterbox or squeeze mode, 
generating correction data for further correcting the aspect 
ratio of the digital image data, multiplexing the digital image 
data and the correction data, and recording the multiplexed data 
on a recording medium. 

In accordance with still another aspect of the 
invention, an image display control device comprises means for 
separating digital image data and correction data from 
multiplexed data containing digital image data which has been 
compressed and corrected for aspect ratio, as in the letterbox or 
squeeze mode, and correction data for further correcting the 
aspect ratio of the digital image data, and means for controlling 
further correction of the aspect ratio of the separated image 
corresponding to the separated digital image data according to 
the separated correction data. 

In accordance with a further aspect of the 
invention, an image display control method comprises the steps of 
separating digital image data and correction data from 
multiplexed data containing digital image data which has been 
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compressed and corrected for aspect ratio, as in the letterbox or 
squeeze node, and correction data tor further correcting the 
aspect ratio of the digital image data, and controlling the 
correction of the aspect ratio of the image corresponding to the 
digital image data according to the separated correction data. 

In accordance with a still further aspect of the 
invention, an image display control device comprises means for 
separating digital image data and correction data from 
multiplexed data containing digital image data which has been 
compressed and corrected for aspect ratio, as in the letterbox or 
squeeze mode, and correction data for further correcting the 
aspect ratio of the digital image data, and means for generating 
a correction signal indicating the correction state of the aspect 
ratio of the image corresponding to the digital image data 
according to the separated correction data and for superimposing 
said correction signal on the signal corresponding to the 
separated digital image data. 

In accordance with yet another aspect of the 
invention , an Image display control method comprises the steps of 
separating digital image data and correction data from 
multiplexed data containing digital image data which has been 
compressed and corrected for aspect ratio, as in the letterbox or 
squeeze mode, and correction data for correction of the aspect 
ratio of the digital image data, generating a correction signal 
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indicating the correction state of the aspect ratio of the image 
corresponding to the digital image data according to the 
separated correction data, and outputting said correction signal 
toy superimposing it on the signal corresponding to the separated 
digital image data. 

In accordance with yet a further aspect of the 
Invention, an image data recording medium on which compressed 
digital image data is recorded, is characterised in that, in 
addition to compressing , correcting the aspect ratio of and 
recording the digital image data, correction data for further 
correcting the aspect ratio of the digital image data are 
multiplexed and recorded with the digital image data. 

The above, and other objects, features and 
advantages of the invention, will be apparent in the following 
detailed description of illustrative embodiments thereof which is 
to be read in connection with the accompanying drawings. 
Brief Description of the Drawings 

Fig. 1A through Fig. 1G are diagrams showing image 
data for screens having various aspect ratios and which are 
selectively corrected to permit display on screens having 4:3 
aspect ratios; 

Fig. 2 Lm a bloc* diagram showing a user 
controlled arrangement in a conventional wide screen television 
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set having a display with a 16:9 aspect ratio, and by which input: 
images with a 4:3 aspect ratio can be displayed; 

Fig. 3 A through Fig. 3F are diagrams to which 
reference is made in explaining the operation of the arrangement 
in Fig. 2; 

Fig. 4A through Fig. 4C are diagrams showing 
various display positions of an active image region; 

Fig. 5A through Fig. 5D are diagrams showing 
various display positions of subtitles; 

Fig. 6 is a diagram showing the transmission 
waveform of identification signals specified by CPX-1204 of the 
EXAJ; 

Fig. 7 is a diagram showing the structure of bits 
transmitted by the waveform in Fig. 6; 

Fig. B Is a diagram showing the content of the 
bits of WORDO in Fig. 7; 

Fig. 9 is a diagram showing the transmission 
waveform of identification signals in WSS (Wide Screen 
signaling) ; 

Fig. 10 is a table showing the content of bits 
transmitted by the waveform in Fig. 9; 

Fig. 11 is a table showing in detail the aspect 

ratio 

data of Group 1 in Fig. 10; 

WM. -JUL.1S\3*».Arr -12- 
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Tigs. 12A and 12B are diagram* .having respective 
example, of subtitle poaitioning with the letterbox mode display; 

Pig. 13 i» e table shoving in detail the aspect 

ratio 

labels in Fig. 11; 

Fig. 14 ia a table shoving in detail the values 
of bit 4 or Group 2 in Fig. 10 for indicating the camera and film 
modes, respectively; 

Fig. 15 is a table shoving the content of bit B of 

Group 3 in Fig. io; 

Fig. 16 is a table showing the contents of bits 9 

and 10 of Group 3 in Fig. 10; 

Fig. 17 is a diagram shoving the bit structure of 

extended CPX-1204; 

Fig. 18 ia a table showing the bit content of 

W0RD0 in Fig. 17; 

Fig- 19 is a table shoving the contents of WORD1 

in Fig- 17; 

Fig. 20 is a table shoving the contents of WORD 2 
when WORD1 in Fig. 17 is "OOOO"; 

Fig. 21 is a table shoving the contents of bits 7 
and 6 in Fig. 20; 

Fig. 22 is a table shoving the contents of WORD2 
when WORD1 in Fig- 17 ia "oooi"; 

SOM-JUL.13VMSB.APP -13- 
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Fig. 23 is a tabls showing the contents of bits 7 
and 8 in Fig. 22; 

Fig. 24 is a table snowing the contents of bits 9 

and 

10 in Fig. 22; 

Fig. 25 is a table snowing the contents of word 2 
When MOBDl in Fig. 17 is "0010"; 

Fig. 26 is a table showing the content of bit 7 in 

Fig. 25; 

Fig. 27 is a table showing the contents of bits 8 
through 14 in Fig. 25; 

Fig. 28 is a table showing the contents of the 
identification signal in XDS; 

Fig. 29 is a table showing the subtitle position; 

Fig. 30 is another diagram showing the subtitle 

position; 

Fig. 31 is a diagram showing the structure of a 

program stream; 

Fig. 32A through Fig. 32C are diagrams showing the 
data content of the MPEG 2 system stream; 

Fig. 33 is a diagram showing the structure of an 
entry sector of the MPEG 2 system stream; 

Fig- 34 is a diagram showing the structure of the 
program stream map in Fig. 33; 
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Pig. 35 is a diagram showing the syntax of the 
program stream up in Fig. 34; 

Fig. 36 is a diagram shoving the syntax of global- 
descriptors in Pig. 35; 

Pig. 37 is a diagram shoving the syntax of 
elementary stream descriptors in Pig. 35; 

Fig. 38 is a diagram shoving the tags of 

descriptors; 

Fig. 39 is a diagram shoving the 
DVD_video descriptor syntax; 

Fig- 40 is a table shoving the aspect_ratio_code ; 
Fig- 41 is a table shoving the frame_rate code; 
Fig. 42 is a diagram shoving the video syntax; 
Fig. 43 is a diagram shoving the syntax of 

user_data; 

Fig- 44 is a diagram shoving user data () ; 

Fig. 45 is a block diagram shoving an image data 
recording device according to an embodiment of the invention; 

Fig. 46 is a block diagram shoving an optical disc 
playback device according to an embodiment of the invention; 

Fig. 47 is a block diagram generally shoving 
another example of an optical dlac playback device according to 
an embodiment of the invention; 
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Fig. 48 is a block diagram shoving a more detailed 
example of the structure of the embodiment: in Fig. 47; 

Fig. 49 la a diagram to vhich reference will be 
made in explaining the operation of the embodiment in Fig. 48; 



Fig. 50 is a block diagram shoving an optical disc 
playback device according to still another embodiment of the 
invention. 

Detailed Description of the Preferred Embodiments 

In accordance with an embodiment of the invention, 
correction data for correcting the aspect ratio, at least in the 
squeeze mode or letterbox mode, is transmitted or recorded after 
multiplexing such correction data with digital image data that 
has been compressed and initially corrected for aspect ratio. 
First, a description will bo given of a method of transmission of 
this correction data and other additional data added to other 
video signals. 

The specifications for transmission of 
identification signals and additional data are stipulated by 
CPX-1202 and CPX-1204 in the EIAJ (Electronic Industries 
Association of Japan) . 

According to CPX-1202, vhich specifies 
"identification signals for video signals with differing aspect 
ratios, and their method of transmission", the method prescribed 

•OM-JUL.ISOOU.A** —16— 
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for an identification signal is to super impose a specific level 
of DC voltage on the 8 terminal which outputs the video signal. 
For example, the value of the superimposed DC voltage is 
specified to be 3 volts for the letterbox node, 5 volts for the 
squeeze mode, and o volts for other situations. Thus, for 
example, by appropriately varying this super-imposed DC voltage 
value according to the correction data for the transmitted 
digital image data, it is possible to specify whether this image 
data should be corrected for aspect ratio in the letterbox mode 
or corrected for aspect ratio in the squeeze mode. Correction of 
the aspect ratio can be controlled according to the value of this 
DC superimposed voltage at the S terminal during reception and 
playback. 

On the other hand, CPX-1024, which provides for 
■identification signals for video signal* with different aspect 
ratios and their method of transmission (II) " (known as ID-1, 
video ID) , stipulates that a 20 bit identification signal with a 
signal wave form shown in Fig. 6 shall be encoded and transmitted 
on the 20th line and 283rd line of the vertical blanking interval 
of the NTSC luminance signal. In other words, the standard Ref 
signal is positioned with a 2.232 us ± 20 ss width at a location 
11.2 us ± o.6 us from the falling edge of the horizontal 
synchronisation signal, followed by a qap of the same width, and 
then by 20 bits of data, bits 1-20, of the same width. 
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These 20 bits of data, as shown in Fig. 7, 
comprise a 6 bit: WORDQ, a 4 bit WORD1, a 4 bit: WORD2 and a 6 bit: 
CRC. WORDO is in turn comprised of a 3 bit WORDO -A and a 3 bit 
WDRDO-B. 

WQRDO is assigned a basic parameter with the main 
purpose of effecting automatic control at the receiving 
equipment, and WORDO-A contains, as shown in Fig. 8, 
identification data relating to the transmission format of the 
image signal. 

In other words, bit 1 of WORDO— A is set to "l" 
when the aspect ratio of the transmitted image data is 16:9 (when 
in full mode), and "O" when such aspect ratio is 4:3. 
Furthermore, bit 2 of WORDO-A is set to "l" when the image 
display format ie letterbox mode and N O u when it is normal. 

Identification data relating to the image or to 
other signals, for example, audio signals or the like, that are 
transmitted simultaneously with and associated with the image, 
can be positioned in WORDO -B. 

Identification signals subordinate to WORDO can be 
positioned in WORD1, and identification signals and data or the 
like subordinate to WORDO can also be positioned in WORD2. The 
CRC code is an error check code, of which the generating 
polynomial G(X) is X6 + X + 1, and all the bits are preset to 1. 

CPX-1204 defines the situation for television 
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idontif i- cation signals in accordance with the NTSC system, in 
other words a system which has 525 lines. In Europe, in the same 
way, the ETSI (European Telecommunications Standards Institute) 
stipulates WSS (wide screen signalling) regulations ror 
Identification signals in the 625-line PAX system and the GECAM 
television system. 

These WSS regulations stipulate that a 14 bit 
identification signal be encoded and transmitted on the 23rd line 
of the PAL signal, as shown in Fig. 9. As also shown in Fig. 9, 
at the start of the 23rd line there are positions for a run-in 
for generating a clock, followed by a start code representing the 
»tart of the code, and then the 14 bits of data at 833 kHz. 

As shown In Fig. 10, the aspect ratio data is 
positioned in the bits of Group l which la comprised of the first 
4 bits of the 14 bits, the PAL-plus related data is positioned in 
the next 4 bits comprising Group 2, and the subtitle data is 
positioned in the next 3 bits comprising Group 3, with the final 
3 bits in Group 4 being unassigned. 

The 4 bits in Group 1 identified as bits b 3# bj, 
b 1# and b G on Fig. 11 set the aspect ratio data by being assigned 
particular values. For example, when the 4 bits in Group 1 are 
"1000*, this represents an aspect ratio of «:3, which corresponds 
to a normal image (full format). When the 4 bits in Group 1 are 
•O001«, this represents the 14:9 aspect ratio of a letterbox 
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image, and indicates that the position of the active image region 
ia in the cantor, for example, a* in Figa. 4a and 12A- 

Vhen the 4 bit* in Group 1 are "0O1O", this 
indicatoe a letterbox image with a 14:9 aspect ratio, but with 
the picture being displayed in the top position, as in Figa. 4B 
and 12B. 

X center letterbox display means that the 
effective image or active image region is positioned in the 
middle of the screen, aa shown in Fig. 12A, with dark or non- 
image portion* displayed above and below the image. A top 
display, as shown in Fig. 12B, means that the effective or active 
image region is displayed only at the top of the screen, with a 
dark portion displayed at the lower part of the screen. 

Fig. 13 gives ranges for the specified aspect 
ratios shown in Fig. 11. In other words, when set to «10OO» the 
4 bits in Fig. 11 generally indicate a 4:3 aspect ratio, when set 
to "0001" a 14:9 aspect ratio is generally indicated, when set to 
"1011" a 16:9 aspect ratio in generally indicated and when set to 
"1101" a larger aspect ratio (> 16:9) is indicated. More 
specifically, a 4s 3 aspect ratio means that, when expressing the 
A:B aspect ratio as a (= A/B) as shown in Fig. 13, the value of a 
is no more than 1.46. Moreover, a 14:9 aspect ratio means that a 
is greater than 1.46 and no more than 1.66, a 16:9 aspect ratio 
means that a is greater than 1.66 and no tcore than 1-90, and an 
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aspect ratio greater than 16 r9, aeoiu tliat a. is greater than 
1.90. 



indicated at b 4 on Fig* 14 , indicates the camera mode when it is 
"0", and the film mode when it is In other words "0" 



"1" indicates that the image has been converted from film by a 
telecine or the like. 

Bits 5 through 7 of Group 2 in Fig. id are not 
used at present. 

Bit 8 of Group 3, indicated at 03 in Fig. 15, 
indicates that there are no subtitles present on the teletext 
when b 8 is »0» , and that there are subtitles on the teletext when 
bg is "i". 

Moreover, when bit 9 {bg) and bit 10 (b ao ) of 
Group 3 are «00", respectively, as shown in Fig. 16, that 
indicates that there are no open subtitles, when bg and b 10 are 
w 10", there are subtitles on the active image region of the 
screen, and when b 9 and b xo are "Ol", there are subtitles on the 
dark portion or portions of the screen. At present, h 9 and b 10 
being "11" is not used. 



image region of the screen and/or on a dark portion, as shown in 
Fig. 12A and rig. 12B. 



Of the 4 bits in Group 2 of Fig. 10, bit 4, 



indicates that the image is from a normal television 



ra, and 



The subtitles may be positioned within the active 
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Bit 1 and bit 2 of WORD 0 -A in CPX-1204 shown in 
Fig. 8 can be automatically act: according to the WSS aspect ratio 
data shown in Fig. 11. For example, when b 3 , bj, b 2 and bg are 
"oill" in Fig. 11, bit 1 of Fig. 8 is assigned "l» f and when b 3 , 
bj, b A and in Fig. 11 are in any other state, bit 1 in Fig. 8 
is assigned 0. Moreover, when the bits b 3 , b 2 , b 1 and b 0 in Fig. 
11 are "0001", "0010" , "1011", "0100" or "1101", bit 2 of Fig. 8 
is assigned the value "l", and when the bits b 3 , bj, b x and b 0 of 
Fig. 11 are "1000", "1110", or "0111", bit 2 of Fig- 8 is 
assigned the value "0". 

Recently there has been discussion about the 
expansion of CPX-1204 (hereinafter referred to as expanded 
CPX-1204). With expanded CPX-1204, of the 20 bits shown for 
example in Fig. 17, the first two bits are WORD0, the next 4 bits 
are WORD1, the next 8 bits are word 2 , and the last 6 bits are 

cue. 

With expanded CPX-1204, identification data for 
the image clonal transmission format is positioned in WORDO, as 
shown in Fig. 18. When bit 1 in W0RD0 is "1", this Indicates 
that the aspect ratio is a 16:9 full mode (squeeze mode) . and 
when bit 1 is "0", this indicates that the aspect ratio is 4:3. 
Moreover , when bit 2 of WORDO is "1", this indicates that the 
image display format la letterbox , and when bit 2 of WORD0 in 
"O", this indicates that imago display format is normal. 

■0*6- JUL. 13VM36.M* -22- 
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In this way, KORD0 in Fig. 17 ie defined so that; 
compatibility is maintained with ths bit 1 and 2 portions of 
WORD0-A in Fig. 7. 

Moreover, as shown in Fig. 19, WORDI represents a 
header ■pacifying the data transmitted in W0RD2. For example, 
when ths 4 bits from bits 3 to 6 are "OOOO" they indicate that 
W0RD2 is digital copy data, and when bits 3 to 6 are "oooi" that 
indicates that WORD2 is data referring to image format r and when 
bite 3 to 6 are "0010" that indicates that WORD2 is subtitle 
position data. 

WORD2 indicates data of a type specified by the 
header of WORDI, and when WORDI is "0000", thereby indicating 
digital copy data in WORD2, the content shown in Fig. 20 is 
specified by the 8 bits from bit 7 to bit 14 in WORD2. In other 
words, in the embodiment illustrated in Fig. 20, only bit 7 and 
bit 8 are effectively specified, and the CGMS-A (Copy Generation 
Management System - Analogue Interface) table shown in Fig. 21 is 
specified as depending on whether bit 7 and bit 8 are "1" or "O". 
When the value of bits 7 and 8 io "00" this Indicates that the 
image data may be freely copied, bits 7 and 8 having the value 
"01" is unused, bits 7 and 8 having the value "io" indicates that 
only l copy ie authorized, antj hit* 7 and 8 having the value "11" 
indicates that copies are prohibited. 
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Moreover, when WQHOl is «0001« indicating that 
V0RD2 contain* data relating to image format, WORD2 is specified 
as shown in Fig. 22. in other words, the screen size is 
determined by bite 7 and 8, as shown in Fig, 23, and the screen 
position is determined by bits 9 and 10, as shown in Fig. 24. 

Furthermore, bit 11 of WORD2, when it has the 
value -1-, indicates that the subtitles are on the non-image or 
dark portion, and bit n indicates that there are no subtitles 
when it has the value "0". 

As shown in Fig. 23, the screen size is 4:3 when 
bit 7 and bit 8 are «0O«, the screen size is 14:9 letterbox mode 
when bits 7 and 8 are -01- , the screen size is 16:9 letterbox 
mode when bits 7 and 8 are "01", and the screen size is 
Cinemascope letterbox mode when bits 7 and 8 are "11". 

Moreover, as shown in Fig. 24, screen position is 
in the center when bits 9 and 10 are «oo«, and when bits 9 and 10 
are «0l« or »io*, the screen position is at the top or the 
bottom, respectively. The value -ll» for the bits 9 and 10 is 
not used. 

Furthermore, when WORD1 is "0010" r thereby 
indicating active image region ponition data including subtitles 

in WORM, as «hown in Fig. 25, bit 7 Of WORD 2 indicates, by being 
-1- or -0-, whether the display position for the active i,nage 
region including subtitles shown by bits 8 through 14 is the top 
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erf the screen or the bottom of the screen, respectively, as 
indicated in Fig. 26. 

Moreover, values of 0 through 127 indicated by 
bits 8 through 14 of WORD2, as shown in Fig. 27, indicate the 
line number from the top of the screen for the top end or bottom 
end of the active image region including subtitle*. For example 
vhen bit 7 is "l* and the value indicated by bits 8 through 14 is 
o, the top end of the active image region including subtitles Is 
displayed on the 22nd line from the top end of the screen, and 
when the value indicated by bits 8 through 14 is 2, it indicates 
that the top end of the active image region including subtitles 
is displayed on the 24th line of the screen. Moreover, when bit 

7 is «o* and the value indicated by bits 8 through n is 0, the 
bottom end of the active image region including subtitles is 
displayed on the 262nd line, and vhen the value indicated by bits 

8 through 14 is 2, the bottom end of the active image region 
including subtitle* is the 260th line. 

When wordi (- "0010") is transmitted, it is 
transmitted at least two times in 2 seconds. 

In America, besides using a system similar to 
CPX-1204, additional data, such as, image aspect ratio data can 
be transmitted by xds (Extended Data Services) ( formerly known as 
EOS) specified by EIA-608. With this XDS , a 16 bit signal with 
parity is inserted on the 2ist line and the 284th line of an NTSC 
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television signal, and in this way, a* shown in Fig. 28 for 
example, the position or the active image region and 
identification of the squeeze node or normal mode con be 
transmitted. The start line for the active image region is 
indicated by the 6 bits SO to 85 shown in Fig. 28, and the final 
line of the active image region is indicated by the 6 bits EO to 
E5. Moreover, the squeeze mode is indicated when QO is "1" and 
the normal mode is indicated when Q0 is "0". 

Figs. 29 and 30 schematically show this Kind of 
subtitle position information and how it is used. For example, 
as shown in Fig. 29, the first line of the active image region is 
represented by bits so through. 85, and the last line is 
represented by bits E0 through E5. Moreover, where the bottom 
line of the subtitles (ABC) is known, the lines from the top line 
of the active image region to the bottom line of the subtitles 
can be selected by the vertical filter and displayed. 

Moreover, as shown in Fig. 30 , when dark portions 
are added both to the top and bottom of the active image region 
and subtitles are displayed on both of these dark portions, 
respectively, if the top line of the upper subtitle and the 
bottom line of the lower subtitle are known, the range from the 
top line of the upper subtitle to the bottom line of the lower 
subtitle can be selected by the vertical filter and displayed. 
In this way it is possible to arrange for a complete display not 
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only of the active image region but also of the subtitles, 
without drop outs. 

In the embodiment of the invention being here 
described, identification signal data determined by the above 
•pacification* is compressed, using the MPEG system, and 
transmitted, after multiplexing with digital image data which has 
its aspect ratio corrected, for example, in the letterbox or 
-queece mode, such transmitted data, upon being received, is 
recorded in a recording medium or played back on a playback 
device. The format for such transmission and/or recording will 
now be described with reference to Pig. 31 which diagrammatically 
-hows the format or syntax of a program stream, for example, an 
MPEG 2 system stream. in Fig. 31, the program stream is shown to 
be composed of n packs, with a pack header being positioned at 
the head of each pack. In addition to a pack start code, an SCR, 
* program mux rate, a pack stuffing length, a pack stuffing byte 

end tbe like being positioned in each pack, PES packets 1 n 

are sequentially placed after a system header. 

The system header is shown to comprise a system 
header start code, a header length, a rate bound and the like. 

Furthermore, a stream id, a P-STD buffer bound 
««!*, « p-std buffer sire bound and the like are included in an 
H loop of the system header. 
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Fig. 32A BhowB an example of a bit: stream which 
has been multiplexed in accordance with the syntax shown in Fig. 
31. in other words , as shown in Fig. 32A, video packets, subtitle 
packets, audio packets and ths like arc transmitted in units of a 
packet. When recording on a disc, the various packets are 
recorded in units of a sector. 

Each packet, as shown in Fig. 32B, is composed of 
a packet header and packet data. If the packet is a video 
packet, as shown in Fig. 32C for example, a picture header, a 
picture coding extension, picture data, and, although not shown 
in the example of Fig. 32C, a group picture header, a sequence 
header and a sequence end code can all also be included in this 
packet data. 

Of this picture data, a sector of a video packet 
containing I picture data is specified u the entry sector. A 
pack header PSD (Program Stream Director) and a PSM (Program 
Stream Map) are positioned in this entry sector. m other words, 
a program stream map (PSM) is positioned immediately before the I 
picture. 

The overall structure or layout of the entry 
sector is shown on Fig. 33. More specifically, a pack header is 
positioned at th« head of the entry aector, end a system header 
is optionally also positioned here. Next come the PSD end the 
PSM, followed by other packets. 

p -2B- 



ThQ format or syntax of the program stream map 
(PSK) la shown diagrammatical ly on Fig. 34 to start with a 24 
byte packet start coda prefix, followed by an 8 byte map stream 
ID, a 16 byte program stream map length, and a 1 byte current 
next indicator and so on. 

The syntax of the PSK in Fig. 34 is further shown 
in Fig. 35 in which bslbf denotes bit string left bit first, and 
uimshf denotes unsigned integer msb first. Moreover, rpchof 
denotes remainder polynomial coefficients highest order first. 
The syntax of the global_deecriptors ( ) in the PSM syntax in this 
Fig. 35 is shown in Fig. 36, and the syntax of the elementary 
stream descriptors in Fig. 35 is shown in Fig. 37. 

Xn the dvd_yideo_descriptor{) in the elementary 
stream descriptors syntax shown of Fig. 37, a variety of 
identifying signals are recorded as described later with 
reference to Fig. 39, but oxdf is added ae a descriptor line tag 
for this dvd_video_descriptor() as shown in Fig. 38. In Fig. 38 
various additional descriptor tags are ehown for identifying the 
respective descriptors. Moreover, as shown in Fig. 38, the 
dvd_vid*©_ descriptor () is independently specified by DVD (digital 
video disc) specifications. 

The syntax of a dvd_video_deacr iptor ( ) Is shown in 
Fig. 39 in which the descriptor_tag is a tag for identifying this 
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dvd_vid«,_d«ecriptor, and as described wltn reference to Pig. 38, 
Oxdf is entered here. 

Descrlptor_length im Pig. 39 expresses the length 
of thin dvd_video_deBcriptor. Horieontal_si«e and vertical_size 
are respectively coded, and express the horizontal and vertical 
size of the recorded transmitted image data in pixel units. 
Display^ horizontal_olze and display_yertlcal_ B ize indicate 
respectively the horizontal length and the vertical length of the 
rectangular region that is to be displsyed. Where this 
rectangular region i. -mailer than the coded image region, it is 
arranged in the display process that part of the coded image is 
displayed, in the reverse case, that is, where the rectangular 
region is larger than the coded image region, in the display 
process the playback image is displayed on part of the display 
device end the remaining area ha. dark portions added tnereto. 

The fllm_or_camera_flag in the case of wss (wide 
screen signalling). «s explained with reference to Fig. 14, is a 
flag Indicating whether this l Mge has been taJcen free a camera 
or is one converted fro. a film image to . video signal. 

With the closed_gop_flag. the GOP (group of 
Picture) is assigned "1- if reference is not made to the 
immedietly preceding cop. «nd -o" if aucn reference is mede. 

The stlll_pieture_flag, where a still image is 
displayed for a specified time, is a flag indicating whether 



or 
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not it 1b an image between the fir at still picture and the last 
■till picture. 

The edge_crop_f lag in Fig. 39 is a flag indicating 
Whether or not an edge crop mode display, which will be explained 
later with reference to Fig. 49, is prohibited. 

The anpect_ratio_code in Fig. 39 is further shown 
in Fig. 40 where it is indicated that the value -0000" cannot be 
used. When the aspect_ratio_code has the value -0001", it 
indicates that the aspect ratio of the pixels composing the image 
is 1:1, when the value is "0010" that Indicates the diaplay 
aspect ratio is 4:3, when the value is "0011" that indicates the 
aspect ratio is 16:9, and, when the value ia "0100" that 
indicates the aspect ratio is 2.21s x. 

The frame_rate_code is as shown in Fig. 41, which 
Indicates that use of the value -0000- is prohibited, while the 
value -0001- indicates that the frame rate of the video signal 
(frame frequency) is 23.976Hz, the value «Q010- indicates that 
the frame rate is 25Hz the value, "0011- indicates that the frame 
rate is 24Hz and the value -0100- indicates that the frame rate 
iB 29.97H*. Further, the value -0101- indicates a frame rate of 
30Hz, the value -Olio- indicates a frame rate of 50 Hz, the value 
-0111- indicates a frame rate of 59.9 Hz, and the value -1000- 
indlcates a frame rate of 60 Hz. 
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Further, In rig. 39, the WSS_aspoct_ratio — code 
indicates aspect ratio data for the 4 bits of Croup 1 shown in 
Pig. 10, and the WSS_sTifafcitle*_vithin_taletext_f lag is a flag 
indicating the presence of bit 6 teletext subtitles amongst the 3 
bit aubtitle data of Group 3 in Fig. 10 (in other words the flag 
shown in Fig. 15). 

When generating added data under CPX-1204, wss, 
extended CPX-1204 and the like, as shown in Fig. 40 it is also 
possible to use the aspect ratio cod* in place of the 
W3S_aepect_ratio_code. Moreover, the WSS_subtitling_mode on Fig. 
39 in indicated by bit 9 and bit 10 of the 3 bit subtitle data in 
Group 3 in Fig. 10, and indicates the subtitle position mode (in 
other words the mode shown in Fig. 16.) 

The cgms_a_eode on Fig. 39 records the digital 
copy data in extended CPX-1204 (Pig. 19), in other words the data 
of bit 7 and bit fi in Figs. 20 and 21. 

Extl204_screen_size_code on Fig. 39 records the 
screen size specified by bit 7 and bit B of WORD 2 in Fig- 23. 

Eactl204_Bcreen__position_code on Fig. 39 records 
the screen position value specified by bit 9 and bit lO or word 2 
shown in Figs. 22 and 24. 

Ext 12 04__subt it 1 e_j>oa i t io n_upp er and 
extl204_subtitle_- poeitionlover on Fig. 39, respectively. 
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indicate the line positions of the upper end and lover end of the 
top or hot ton, respectively/ of the subtitles in Fig. 27. 

In the above described first embodiment, the 
various identification signals or added data shown in Fig. 39 are 
arranged to be recorded in the PSK (program stream map) , but it 
is also possible to record then in the vid*o_I*ayer of the User 
Data rather than in the PSK. 

In other words as shown in Fig. 42, in the video 
syntax specified by MPEG 2, extensions _and_user_data (2) are 
provided following picture_header() and 

picture_coding_extension() . Following the syntax of this 
extens iono_and_user_data (2), it is possible, for example, to 
record the necessary encoded identification signals as follows. 

Zn the syntax of the user_data specified in MPEG, 
it is possible to specify the user_data as shown in Fig. 43- As 
shown in Fig. 44, the user data is recorded in accordance with 
the MPEG specification, and it will be seen that the content 
recorded here is essentially similar to that recorded in the 
dvd_video_descriptor as shown in Fig. 39. 

In Fig. 44, mar)cer_bit() is an 8 bit string of 
data llliiiii which, combined with data at either side of it, is 
Inserted to prevent generation or emulation of unusual data such 
as the user data start code. 
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An embodiment of a device which transmits 
identification signals or added data multiplexed with digital 
video image data for images which have been compressed and had 
their aspect ratio corrected using the MPEG system, and which 
records such multiplexed data, using a disc as a recording 
medium, will now be described with reference to Fig- 45- 

in this transmitting and recording device, an 
audio encoder 102 uses the HP eg system to compress and encode 
audio signals supplied to the audio input, and outputs them to a 
multiplexing device 113. A video encoder 101 also uses the HP EG 
system to compress and encode video signals supplied to the video 
input, and outputs them to multiplexing device 113. In this 
case, the stream output from audio encoder 102 is designated as 
an MPEG 2 audio stream or audio layer, and the stream output from 
video encoder 101 is designated an MPEG 2 video stream (Fig. 
32C) . 

Moreover, in this embodiment, video encoder 101 is 
arranged so that it basically encodes images with an aspect ratio 
of 4:3. images with a wide aspect ratio, such as, 16:9, 14:9, 
2:1 and the like, are input to video encoder 101 after processing 
for correction or the aspect ratio in the letterbox mode or 
squeeze mode, as described with reference to Fig. 1A through 
Fig. 1G. 
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Multiplexing device 113 divides the MPEG video 
stream and kp EG audio stream into packets toy time-division 
Multiplexing as ibavn in Fig* 32A* 

Although not shown in the diagram, it is also 
po ss i b le to supply a subtitle stream to multiplexing device 113 
and to multiplex this together with the video stream and the 
audio stream. In such case, the MPEG 2 system stream output from 
multiplexing device 113 will, as shown in Fig. 32A, include 
subtitle packets in addition to video packets and audio packets. 

Multiplexing device 113 forms ox- holds psm 
regions, but this is done by creating blank spaces before 
multiplexing, with the actual or additional data being written by 
a PSX data overwrite circuit 155. 

The output of an entry detector circuit 13 1 is 
supplied to an entry point data memory or storage circuit 133. 
Entry point data memory circuit 133 receives and stores entry 
point data, that is, data on the generation point of the I 
picture as detected and output by the entry point detector 
circuit 131. 

A TOC (table of contents) data generation circuit 
156 examines the stored content of entry point data memory 
circuit 133 and ganoratan TOC (table of contents) data which 
includes the disc name, chapter names, the start addresses of 
each chapter on the disc, the required disc playback time, the 
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required chapter playback times, the start address of each entry 
eector and the like. 

The multiplexed stream output from multiplexing 
circuit 113, after being held temporarily in a DSM (digital 
storage media) 110, ia read out from DSM 110 and supplied to a 
TOC adder circuit 150. TOC adder circuit 150 adds TOC data 
generated by TOC data generator circuit 156 to the multiplexed 
stream supplied from DSM HO and supplies the resulting output to 
PSM data overwrite circuit 1S5. 

From the output of video encoder loi, a generator 
circuit 157 generates PSM data (dvd^yideo^de scrip tor) as shown in 
Fig. 39 and described above, and outputs this to PSM data 
overwrite circuit 155. PSM data overwrite circuit 155 overwrites 
the PSM data into the entry sector region in order to write the 
PSM data in the multiplexed bit stream held by multiplexing 
device 113. 

The output of PSM overwrite circuit 155 is 
supplied to a sector header adder circuit 151, and here the 
multiplexed stream is divided by sector and a sector header is 
added to aach sector. Data to which sector headers have been 
added by sector header adder circuit 151 are input to an ECC 
(error detection and correction) encoder 152, and an encoding 
process is carried out to detect and correct errors. 
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Data output from ECC encoder 152 is input to a 
modulator circuit 153 where it is, subjected to EPK (Eight to 
Fourteen Modulation) , and the nodulated output io transmitted to 
a transmission path or the like. In this embodiment, such 
transmission path is constituted by a recording or cutting 
machine 154. 

In cutting machine 154 the multiplexed stream of 
data is recorded by forming pits in the surface of a disc 160 
according to the data input from modulation circuit 153. Using 
this disc 160 as a master , a plurality or replica DVDs (digital 
video discs) can be manufactured. 

An example of a playback device which reproduces 
of plays back an optical disc or DVD 1 generated by the above 
process, will now tee described with reference to Fig- 46. The 
disc 1 is rotated at a particular rate by a spindle motor (not 
shown) while laser light from a pick-up 2 scans the tracks of 
optical disc 1 in which the pits have been formed. Thus, the. 
digital data compressed tey tne MPEG system recorded in the tracks 
is read out. This digital data is input to a demodulator circuit 
3 and after EFM demodulation therein is supplied to a sector 
detector circuit 4. The output of pick-up 2 is also input to a 
phase locked loop (PIX) circuit 9, to regenerate a clock. This 
regenerated clock is supplied to demodulator circuit 3, sector 
detector circuit 4 and the like. 
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As Shown in Fig. 32A, the multiplexed stream of 
data is recorded on optical disc 1 in units which are sectors of 
fixed length, end at the head of each sector is a sector header 
(not shown) , with a sector sync being added to this sector 
header. Sector detector circuit 4 detects the divisions between 
sectors by detecting these sector syncs. Moreover, sector 
detector circuit 4 detects sector addresses, and supplies these 
to a control circuit 6 and a track jump decision circuit 7. 

Data output from demodulation circuit 3 is input 
via sector detector circuit 4 to an ECC (error detection and 
co r rection) circuit 33, where error detection and correction is 
carried out. Data for which the error detection and correction 
process has been performed is written into a ring buffer memory 5 
under the control of control circuit 6. 

The output of ECC circuit 33 is also input to a 
PSM detector circuit 40. PSH detector circuit 40 detects the pbk 
data (added data) in the entry sectors from the input stream 
data, and outputs the detected PSM data to control circuit 6* 
Control circuit 6 controls a eigne 1 generator- 51 according to 
this PSM data. In response to such control, signal generator 51 
generates identification signals supplied to, for example, a 16:9 
aspect ratio display 18. A d/a convortor 17 outputs this 
identification signal to display IB by inserting it into, for 
example, line 20 or line 283 of the vertical blanking interval of 
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an NTSC analogous video signal, as described with reference to 
rig. 6. 

control circuit e specifies the writing address at 
which this sector data is written in ring buffer 5 using a write 
pointer VP based on the sector address of each sector supplied 
from sector detector circuit 4. Furthermore control circuit 6 
specifies the reading address at which data is read from ring 
buffer 5 using read pointer RP based on request signals and codes 
from a video code buffer 10 in the next step. Data read out from 
the position indicated by read pointer RP is then supplied to a 
demultiplexer 32. 

A focus servo circuit 25 generates a focus error 
signal from the output from pickup 2, and is operative to execute 
the focus servo according to this focus error signal. In the 
same way, a tracking servo circuit 8 controls pick-up 2 according 
to a tracking error signal output from pick-up 2, and arranges 
for the tracking servo to be operated. 

A tracking or track jump decision circuit 7 
supplies trade jump command signals to track servo circuit 8 at s 
specified timing according to commands from control circuit 6, 
and causes pick-up 2 to jump or move at high speed to a correct 
or specified track. 
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A uitr interface 31 is operated when the user 
Inputs a specific command, and is arranged so that a 
corresponding command is input to control circuit 6. 

Since the data recorded in optical disc 1 is 
multiplexed encoded data comprising video data, audio data, 
subtitle data and bo on, demultiplexer 32 separates these types 
of data from the data supplied from ring buffer 5, supplies the 
audio data and subtitle data to an audio decoder and a subtitle 
decoder, respectively, (not shown in the diagram) , and supplies 
the video data to video buffer 10 of a video decoder 20. 

Data recorded in video code buffer 10 is supplied, 
in part, to a picture header detector 34. Picture header 
detector 34 detects picture headers from the data input thereto, 
and from these picture headers it detects type data indicating I, 
P and B picture types and temporal reference (TR) data indicating 
the screen order within the gop (group of pictures) . The 
detected picture type data is further supplied to a picture data 
selector circuit 35. Picture data selector circuit 35 selects 
only 1 pictures and P pictures during special playback, and is 
controlled to supply them from video code buffer 10 to an inverse 
variable length coder (VI*C) circuit 11* 

During normal playback, picture data selector 
circuit 35 does not select pictures based on picture type, taut is 
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controlled so as to supply All typos or pictures from picture 
cods buffer 10 to inverse VLC circuit 11. 

Data supplied to inverse VLC circuit 11 and there 
subjected to inverse vlc processing, is thereafter supplied to an 
inverse quantizing circuit 12. Moreover, at this time inverse 
vlc circuit 11 sends code request signals to video code buffer 
10, and receives nev data transferred from video code buffer lo. 

Furthermore, in addition to outputting data 
indicating the quantise step size to inverse quantizing circuit 
12, inverse VLC circuit 11 outputs motion vector data to a motion 
compensation circuit 15. Inverse quantizing circuit 12 quantizes 
data supplied from inverse VLC circuit ll according to a quantize 
step size signal supplied from inverse VLC circuit 11 and 
supplies this to an inverse discrete cosine trans forta (dct) 
circuit 13. After inverse DCT processing of the data input to 
circuit 13, the resulting output of circuit 13 is supplied to an 
addition circuit 14. 

Addition circuit 14 adds together the output of 
inverse DCT circuit 13 and the output of motion compensation 
circuit 15 according to the picture type <I,P, B) and outputs the 
result to a frame memory bank 16. 

Frame memory bank 16 is provided with 3 frame 
memories 16a , 16b, 16c and with a switch 16d which selects one of 
the memories 16a, 16b, and 16c for writing therein, and a switch 
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16a which selects one of the memories 16a p 16b and 16c fp reading 
therefrom. By such Beans, each decoded frame image is supplied 
to D/A converter 17 after reverting to the original frame 
sequence. Moreover , data read out from frame memory banks 16a, 
16b, 16c is supplied where appropriate to motion compensation 
circuit 15 which provides therefrom motion prediction data 
supplied to addition circuit 14. 

D/A converter 17 has an KTSC encoder or a PAL 
encoder built into it, and is arranged to receive digital picture 
data supplied from switch 16e r and to convert such data to an 
KTSC or PAL analog video signal which is supplied to display 18. 

Operation of the device of Fig. 46 in controlling 
the aspect ratio correction state in accordance with detected psm 
data will now be explained. Pick-up 2 play a back data recorded 
on optical disc 1 and outputs such data to demodulation circuit 
3. Demodulation circuit 3 performs EFM demodulation of the 
reproduced data, and outputs the demodulated data to ECC circuit 
33 through sector detector circuit 4- After performing error 
detection and correction, ECC circuit 33 supplies the corrected 
data to ring buffer 5 which temporarily stores the same. 

Data read out from ring buffer 5 is input to 
demultiplexer 32 which, separates subtitle data and audio data 
from the input data and supplies the subtitle data and audio 
data, respectively, to a subtitle decoder and an audio decoder 
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(not shown) . The demultiplexer 32 also separates the video data 
f ran the remainder of the data read from buffer 5 and outputs the 
separated video data to video code buffer 10, 

Data stored in video oode buffer 10 is supplied to 
inverse VLC circuit 11 and, after inverse VLC processing therein, 
is inverse quantised in inverse quantising circuit 12 before 
being subjected to DCT processing in inverse DCT circuit 13. 
Data output from inverse DCT circuit 13 is written in one of the 
frame memories 16a, 16b or 16c through switch I6d after 
compensating for motion at addition circuit 14 with data output 
from motion compensation circuit 15. 

Data written into frame memories 16a through 16c 
is then read out in the original frame sequence through switch 
16e, and is then converted to an NTSC analog video signal at D/A 
converter 17, prior to being output to a 16:9 aspect ratio 
display IB where a corresponding image is displayed. 

At the same time, PSM detector circuit 40 detects 
PSM data in the data output by ECC circuit 33, and outputs such 
detected psm data to control circuit 6. control circuit 6 
outputs control signals corresponding to the PSM data from 
detector circuit 40 to signal generator 51, signal generator 51 
generates specif le identification signals corresponding to such 
control signals, and outputs the identification signals to D/A 
converter 17- These signals, as described above with reference 
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to Pig. 39, are signals corresponding to the content of 
0VD_vid*o_dascr iptor . 

If a vide screen television set 80 with a 16:9 
aspect ratio CRT 85, a horizontal filter 82 and a vertical filter 

83, as shown in Pig. 2, is connected as display 18 in the circuit 
of Pig. 46, signal generator 51 outputs PSK data to d/a converter 
17 , and D/A converter 17 inserts this PSK data in, for example, 
line 20 or line 283, as explained with reference to Pig. 6, of 
the signal then supplied to television set 80. 

In television set 80, as shown in Pig. 2, the 
video signals and the identification signals are separated, from 
each other by television signal demodulator circuit 81, and the 
video signals are output to CRT 85 through horizontal filter 82 
and vertical filter 83. Moreover, the separated identification 
signals are supplied from demodulator circuit 81 to controller 

84. Controller 84 controls horizontal filter 82 and vertical 
filter 83 in accordance with the separated identification 
signals. 

Thus, for example, identification signals 
indicating whether or not the accompanying data has been aspect 
ratio corrected in the letterbox mode or identification signals 
which indicate that the accompanying data has been aspect ratio 
corrected in the squeeze mode are included in the correction data 
as frame data. When supplied with identification signals that 
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indicate neither letterbox node nor squeeze mode (in other words, 
normal mode identification signal*) , controller 84 switches on 
horizontal filter 82 and switches off vertical filter 83. as a 
result of the foregoing, dark portions are added to the left and 
right of a 4:3 aspect ratio active Image region as shown in Fig. 
3jl and a 16:9 aspect ratio screen is displayed on 16:9 aspect 
ratio CRT 85, as shown on Fig. 3D. 

Xf the image is in the letterbox mode, as in Pig, 
3B, controller 84 responds to the corresponding identification 
signals by switching horizontal filter 82 off and vertical filter 
83 on. By this means, as shown in Fig. 3E, only the active image 
region is extracted by vertical filter 83, and displayed on CRT 
85 as a 16:9 aspect ratio screen. 

If the image is in the squeeze mode, as shown on 
Fig. 3C, controller 84 responds to the corresponding 
identification signals by switching off both horizontal filter 82 
and vertical filter 83. As a result, as shown in Fig. 3F, a 
horizontally compressed 4:3 aspect ratio image is extended in the 
horizontal direction in a 16:9 aspect ratio CRT 85, and displayed 
as a normal 16:9 aspect ratio image. 

Moreover, when signals specifying the active image 
region position and the subtitle position, for example, are 
included in PSK data as shown in Figs. 17-27, the television set 
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80 generates a signal by which the line* to be displayed are 
determined bo that there is no subtitle drop- out. 

As shown in the left-hand portion of Pig. 29, for 
example, if the video input to the television set 60 has dark 
portions added to the top and bottom of the screen, as by a 
letterbox conversion, and subtitles are positioned on the lower 
of the two dark portions, omitting the upper and lower dark 
portions, ae in Fig. 3E, would cause drop out of the subtitles 
intended to appear in the lower dark portion. However, in the 
circuit embodying this invention as shown on Fig. 46. signal 
generator 51 generates a signal including range data and 
transmits it to the television set 80 via D/A converter 17 so 
that the range from the top line of the active image region to 
the bottom line of the subtitles la extracted by vertical filter 
83 of the television set and the full image and the subtitles are 
displayed on the 16:9 aspect ratio CRT 85- 

Alternatively, as shown in the left-hand portion 
of Fig. 30, if subtitles are present in both the upper and lower 
dark portions, a signal including range data is generated by 
signal generator 51 so that the range from the top line of the 
upper subtitles to the bottom line of the lower subtitles is 
extracted by the vertical filter S3, and this is transmitted to 
television set 80 by D/A converter 17. 3Tn this way, the 16 1 9 
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aspect ratio CRT 85 displays the lull Image and the subtitles in 
the upper and lover dark portions. 

In the above manner, digitally recorded compressed 
and aspect-ratio- corrected images can be played bade from 
optical disc l and displayed in the same way as analog recorded 
compressed and aspect-ratio corrected images. 

In the embodiment of the invention shown in Fig. 
46, the horizontal filter 82 and the vertical filter 83 are not 
built into the optical disc playback device indicated generally 
at 50, but rather are part of the television set 80 having a 16:9 
aspect ratio CRT 85, as in Pig. 2, and Which is used for the 
display 18 in rig. 46. However, taking into account the fact 
that a playback device may be normally connected to a 4:3 aspect 
ratio display, it is also possible to provide such horizontal and 
vertical filters in the playback device in accordance with this 
invention. In other words, as shown schematically in Fig. 47, in 
an optical disc playback device 50A according to this invention 
Which is otherwise the same as that described above with 
reference to Fig. 46, video signals output from demultiplexer 32 
are supplied to video decoder 20, and video data output from 
video decoder 20 is output to display 18A or 18B through a 
horizontal filter 61 end a vertical filter 62. PSM data detected 
by PSM detector circuit 40 is supplied to control circuit 6 
which controls horizontal filter 61 and vertical filter 62 in 
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accordance which such PSK data. In the embodiment cf Fig. 47, it 
is possible to connect aithar display ISA, which ia a wide ecreen 
televiaion aet having .16:9 aapect ratio, as the display i 8 in 
rig. 46, or, alternatively, a normal NTSC televiaion aet 18B with 
a 4:3 aapect ratio nay be connected as the display 18. 

Pig. 48 ehows in greater detail the manner in 
which the embodiment illuatrated schematically in Fig. 47 may be 
actually arranged. Aa shown in Fig. 48, in thie embodiment video 
data output from frame memory bank 16 is supplied through switch 
16E to D/A converter 17 by way of horizontal filter 61 and 
vertical filter 62. Horizontal filter 61 and vertical filter 62 
are controlled, aa previoualy noted, according to control signals 
output from control circuit 6. Apart from the foregoing, the 
apparatus in Fig. 48 is the same as described above with 
reference to Fig. 46. 

in the embodiment of Fig. 48, the user issues an 
instruction through user interface 31 to control circuit 6 for 
indicating whether display 18 connected to optical disc playback 
device S0A is a 16:9 aspect ratio device ISA or a 4:3 aspect 
ratio device isb. Thie instruction may be formed by actuating a 
predetermined ewiteh constituting user interface 31. 

When diaplay 18 connected to optical playback 
device 50A is display ISA having a 16 = 9 aspect ratio, and whicn 
includes the filters 82 and 83 and controller 84 as integral 
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parts of the display, as In Fig. 2, control circuit 6 switches 
off horizontal filter 61 and vertical filter 62. Thus, in this 
case the structure becomes effectively the same as the embodiment 
shown in Fig. 46, and the operation is the same as has been 
previously described for that embodiment. 

With display 18B having an aspect ratio 4:3, there 
is no horizontal filter or vertical filter included in such 
television set or display 18B. In the case where such display 
18B with a 4:3 aspect ratio is connected as display 18 in Fig. 
48, control circuit 6 controls built in horizontal filter 61 and 
vertical filter 62 in the following way: 

When the image being reproduced is In the normal 
mode, horizontal filter 61 and vertical filter 62 are both 
switched off. As a result a normal image is displayed on 4:3 
aspect ratio display 18B. 

When the image being reproduced or played back is 
in the letterbox mode, control circuit 6 switches off both 
horizontal filter 61 and vertical filter 62. As a result, dark 
portions are added to the top and bottom, and an imago adjusted 
to an overall 4:3 aspect ratio is displayed on display 18B. 

When a squeeze mode image is played back, for 
example, the image indicated at l 1 on Pig. 49, control circuit 6 
controls horizontal filter 61 and vertical filter 62 as follows. 
More specifically, in that case, control circuit 6 switches on 
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horizontal filter 61 and switches off vertical filter 62- As a 
result, part of the image compressed in the horizontal direction 
by horizontal filter 61 is cut out and then the remaining image 
is extended in the horizontal direction, ao that the image is 
displayed in the edge cropped mode on the 4:3 aspect ratio 
display 1SB, for example, as indicated at X 2 on Fig. 49, 

Xn this edge cropped mode shown in Fig. 49, parts 
of the active image region (the left and right edges of the 
image) drop out. As a result, there are cases where, due to 
copyright and other considerations, this edge cropped mode is 
prohibited. In cases where this edge cropped mode display is 
banned as indicated by an edge_crop_f lag , control circuit 6 
switches off horizontal filter 61 and switches on vertical filter 
62. 

Vertical filter 62 compresses in the vertical 
direction a squeeze mode image which has been compressed in the 
horizontal direction, converting it to an image with a normal or 
4:3 aspect ratio, and furthermore adds darx or non-image portions 
above and below the active image region, creating an image I 3 
with an overall aspect ratio of 4:3. In other words it generates 
an image in letterbox mode. Thus this letterbox mode image I 3 is 
output for display on display 18B which has a 4:3 aspect ratio. 

During such letterbox mode display, the user may 
manually activate an edge cropped mode display with control 



—SO— 



2182260 

PATENT 
450100-3638 

circuit 6, thereby switching off vertical filter 62 and switching 
on horizontal filter 61. However, as explained above , in cases 
where this edge cropped node display is prohibited, control 
circuit 6 will not accept this manual command. 

In the sane way, it is possible to manually switch 
from the edge cropped mode to the letterbox mods. 

When changing the image aspect ratio using 
horizontal and vertical filters within the playback device, 
control circuit 6 controls the data generated by signal generator 
51 so that it represents the aspect ratio of images after passing 
through the filters. By this means, even if the user interface 
31 is made to indicate that a 4:3 display is connected to the 
playback device , it is possible at least to ensure a display of 
the correct aspect ratio where, for example, a 16:9 display is in 
fact connected to the playback device. 

In the above embodiment, additional data is 
encoded in the PSK of the system layer as part of the 
identification signal, but it is also possible to encode the 
additional data as a private packet defined in the MPEG system 
layer. Alternatively, the additional data can be encoded as part 
of the «xtenBions_and_UBer_data(0) following the sequencejieader 
for each sequence or encoded as part of the 

extenslons_and_user_data(i) following on from the Group of 
Plcture_header for each Group of Picture, or encoded as part of 
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the ext^nsion*_and_UB*r data ( 2 ) for each Picture (Fig. 42). 
rurthtnwr*, it in also possible to record in the so-called TOC 
region, where information about the disc and a plurality of 
programs is recorded, and which is situated at a specific 
position on the disc for each optical disc or other recording 
medium, as previously disclosed in Japanese Patent Application 
No. H 7-61411. 

In the above-mentioned embodiment of the replay 
device, a description has been given for a NTSC device, but the 
oame effect can be obtained for the PAL system by using the 
above-mentioned WSS signal instead of CFX-1204 and its extended 
version. 

Pig. 50 shows an example of an optical disc 
playback device SOB similar to that shown in Fig. 48, and in 
which the extended data service (XDS) is recorded in a Private 
Stream defined in the HFEG System layer as disclosed previously 
in Japanese Patent Application No. H 7-6902. As shown in Fig. 
50 ' in thi« embodiment the private stream is separated by the 
demultiplexer 32 from the data read from ring buffer 5, and 
supplied to a private stream (XDS signal) decoder 71. 

Private stream decoder 71 decodes the XDS signal 
from the input private stream, and outputs it to an XDS signal 
convert or device 72. Where display 18 has a horizontal filter 82 
and vertical filter 83, as In Fig. a and as explained above, 
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there is no need for any processing by horizontal filter 61 and 
vartlcal filter 62 of optical disc playback davico 5 OB. However, 
where the aapect ratio ia altarod by horizontal and vortical 
filter* 61 and 62, XDS aignal convertor device 72 altera the XDS 
aignal in accordance with the aspect ratio of the output image 
from both filter© in response to a com ma n d from control circuit 
6, and outputs the converted result to XDS signal generator 73, 
XDS signal generator 73 generates an XDS signal according to the 
output from XDS signal convertor device 72, and outputs it to D/A 
convertor 17. D/A convertor 17 inserts the XDS signal from 
generator 73 in lins 21 and line 284, and outputs it to display 
18. 

Xn this way, in the embodiment of Fig. 50 it is 
possible to perform processing in the same way as when the 
identification signal is situated in the PSM. 

Moreover, by adapting signal generator 51 and D/A 
convertor 17 for use with CPX-1202, it is possible to generate 
CPX-1202 signals in the same way as in the playback device 50B 
described with reference to Fig. 50. Moreover, timing data 
indicating the times When these items of correction data are 
effective are recorded together with the correction data, and it 
can he arranged that they are transmitted to display 18 based on 
these timings. This timing data may be recorded for example as a 
PTS (Presentation Time Stamp) and a DTS (Decoding Time Stamp) 
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defined toy MPBG r and when using a PSM, toy using an SCR (System 
Clock Reference) in the pack heador placed immediately before the 



In the above described embodiments, the 
multiplexed date is recorded in the recording medium, and it ie 
arranged Tor this to toe played back with a playback device 50, 
50A or 50B r tout it is of course possible to use the recording 
medium for transmission via a network for reception at remote 
destinations • 

It will bo appreciated that by multiplexing the 
digital image data and the correction data in accordance with the 
invention, as described above, it is possible to always view an 
image in the correct state. 

It will be further appreciated that by recording 
digital image data and correction data on a recording medium 
after multiplexing in accordance with the invention, as described 
above, it is possible to provide a recording medium from which it 
is possible to continually display an image in the correct state. 

Moreover, it will be appreciated that by 
controlling the display in accordance with correction data 
separated from the digital image data, in accordance with the 
invention, as described above, it is possible to continually 
display the image in the correct state. 
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rurtheraore , it will be appreciated that by 
demultiplexing correction data from digital image data, 
generating a correction signal indicating the correction state 
for ths aspect ratio of an image corresponding to the digital 
image data according to the separated correction data and 
superimposing such correction signal on the signal corresponding 
to the separated digital image data in accordance with the 
invention, as described above, it is possible to view the image 
in the correct state whether or not the image display device to 
which output is made has filters which can carry out vertical and 
horizontal processing. 

Finally, it will be appreciated that an image data 
recording medium according to the invention, as described above, 
since it has recorded thereon correction data which has been 
multiplexed with the digital image data, makes it possible to 
continually view an image in the correct state. 

Having described several preferred embodiments of 
the invention in detail, it is to be understood that the 
invention is not limited to those prscise embodiments, and that a 
person skilled in the art could effect many changes and 
modifications therein without departing from the scope or spirit 
of the invention as defined in the appended claims. 
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The embodiments of the invention in which an exclusive 
property or privilege is claimed are defined as follows: 

1, An image data providing apparatus comprising: 

means for supplying digital image data which has been 
compressed in accordance with an MPEG system and which 
has been corrected for aspect ratio and for supplying 
digital audio data and subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
data; 

means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; and 

table of contents (TOC) adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data. 

2. An image data providing apparatus comprising: 

means for supplying digital image data which has been 
compressed in accordance with an MPEG system and which 
has been corrected for aspect ratio and for supplying 
digital audio data arxd subtitle data ; 
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means for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
data; . 

means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; and 

table of contents. (TOC) adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to include 
intraframe- coded (I) pictures, inter frame forward- 
predictive -coded (P) pictures and interframe 
bidirectionally-predictive-coded (B) pictures. 

3.- An image data providing apparatus comprising: 

means for supplying digital image data which has been 
compressed in accordance with an MPEG system and which 
has been corrected for aspect ratio and for supplying 
digital audio data and subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
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data; 

means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; and 

table of contents (TOO adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data; 

wherein said digital image data is compressed in 
accordance with the MPEG system so. as to have a user data 
region immediately prior to a sequence hea.der. 

4. An image data providing apparatus comprising: 

means for supplying digital image data which has been 
compressed in accordance with an MPEG system and which 
has been corrected for aspect ratio and for supplying 
digital audio data and subtitle data; 

means, for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
data; 

means for combining the digital image data, and said* 
subtitle information data so as to generate combined 
digital image data; 
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multiplexing means for multiplexing said combined digital 
image data and said digital audio data; and 

table of contents (TOC) adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to be comprised of 
groups of pictures each having an associated group-of - 
pictures header which is immediately preceded by a user 
data region, 

5. An image data providing apparatus comprising: 

means for supplying digital image data which has been 
compressed in accordance with an MPEG system and which 
has been corrected for aspect ratio and for supplying 
digital audio data and subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
data; 

means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing . said combined digital 
image data and said digital audio data; and 

table of contents (TOC) adder means for adding said 
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digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to include 
successive pictures having. a picture header preceded by a 
user data region. . 

6, An image data providing apparatus comprising: 

means for supplying digital image data which has been 
compressed in accordance with an MPEG system and which 
has been corrected for aspect ratio and for supplying 
digital audio data and subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data, indicative of 
the correction of the aspect ratio of said digital image 
data ; 

means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; . 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; and 

table of contents (TOC) adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data; 

wherein said identification data is data indicating that 
the mode in which said aspect ratio of the digital image 
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data has been corrected is a squeeze mode or a letterbox 
mode . 

7. An. image data providing method comprising the steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and corrected for aspect 
ratio and supplying digital audio data and subtitle data; 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and said subtitle 
information data so as to generate combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; and 

adding said digital aspect ratio identification data and 
image display format data as table of contents (TOC) data 
to the multiplexed data* 

8. An image data providing method comprising the steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and corrected for aspect 
ratio and supplying digital audio data and subtitle data; 

generating subtitle information data in accordance with 
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said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and said subtitle 
information data so as to generate combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; and 

adding said digital aspect ratio identification data and 
image display format data as table of contents (TOC) data 
to the multiplexed data; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to include 
intraframe- coded (I) pictures, interframe forward- 
predictive-coded (P) pictures and interframe 
bidirectionally-predictive-coded (B) pictures. 

9. An image data providing method comprising the steps 
Of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system, and corrected for aspect 
ratio and supplying digital audio data and subtitle data; 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and said subtitle 
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information data so as to generate combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; 

adding said digital aspect ratio identification data and 
image display format data as table of contents (TOG) data 
to the multiplexed data; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to have a user data 
region immediately prior to a sequence header. 

10. An image data providing method comprising the steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and corrected for aspect 
ratio and supplying digital audio data and subtitle data; 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and said subtitle 
information data so as to generate combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; and 

adding said digital aspect ratio identification data and 
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image display format data. as table of contents (TOC) data 
to the multiplexed data; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to be comprised of 
groups of pictures each having an associated group-of- 
pictures header which is immediately preceded by a user 
data region. . . 

11, An image data providing method comprising the steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and corrected for aspect 
ratio and supplying digital audio data and subtitle data; 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and. said subtitle 
information data so as to generate combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; and 

adding said digital aspect ratio identification data and 
image display format data as table of contents (TOC) data 
to the multiplexed data; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to include 
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successive pictures having a picture header preceded by a 
user data region. 

12.. An image data providing method comprising the steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and corrected for aspect 
ratio and supplying digital audio data and subtitle data; 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and said subtitle 
information data so as to generate combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; and 

adding said digital aspect ratio identification data and 
image display format data as table of contents (TOC) data 
to the multiplexed data; 

wherein said digital aspect ratio identification data is 
data indicating that the mode in which said aspect ratio 
of the digital image data has been corrected is a squeeze 
mode or a letterbox mode . 

13. An image data; recording apparatus comprising: 
means for supplying digital image data which has been 
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compressed in accordance with a MPEG system and corrected 
for aspect ratio and for supplying digital audio data and 
subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
data; 

means for combining the digital image data ' and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; 

table of contents. (TOC) adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data 
to form added data; and 

recording means for recording the added data on a 
recording medium. 

14. An image data recording apparatus comprising: 

means for supplying digital image data which has been 
compressed in accordance with a MPEG system and corrected 
for aspect ratio and for supplying digital audio data and 
subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
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digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
data; 

means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; 

table of contents (TOO adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data 
to form added data; and 

recording means for recording the added data on a 
recording medium; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to include 
intra frame -coded (I) pictures, interframe. forward- 
predictive-coded CP) pictures and interframe 
bidirectionally-predictive-coded (B) pictures . 

15. An image data recording apparatus comprising: 

means for supplying digital image, data which has been 
compressed in accordance with a MPEG system and corrected 
for aspect ratio and for supplying digital audio data and 
subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
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digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
data; 

means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; 

table of contents (TOO adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data 
to form added data; and 

recording means for recording the added data on a 
recording medium; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to have a user data 
region immediately prior to a sequencing header. 

16. An image data recording apparatus comprising 

means for supplying digital image data which has been 
compressed in accordance with a MPEG system and corrected 
for aspect ratio and for supplying digital audio data and 
subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
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data; 

means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; 

table of contents (TOC) adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data 
to form added data; and 

recording means for recording the added data on a 
recording medium; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to be comprised of 
groups of pictures each having an associated group- of - 
pictures header which is immediately preceded by a user 
data region. 

17 . An image data recording apparatus comprising: 

means for supplying digital image data which has been 
compressed in accordance with a MPEG system and corrected 
for aspect ratio and for supplying digital audio data and 
subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
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data; 

means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; 

table of contents (TOC) adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data 
to form added data; and 

recording means for recording the added data on a 
recording medium; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to include 
successive pictures having a picture header preceded by a 
user data region. 

18. An image data recording apparatus comprising: 

means for supplying digital image data which has been 
compressed in accordance with a MPEG system and corrected 
for aspect ratio and for supplying digital audio data and 
subtitle data; 

means for generating subtitle information data in 
accordance with said subtitle data and for generating 
digital aspect ratio identification data indicative of 
the correction of the aspect ratio of said digital image 
data; 
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means for combining the digital image data and said 
subtitle information data so as to generate combined 
digital image data; 

multiplexing means for multiplexing said combined digital 
image data and said digital audio data; and 

table of contents (TOC) adder means for adding said 
digital aspect ratio identification data and image 
display format data as TOC data to the multiplexed data 
to form added data; and 

recording means for recording the added data on a 
recording medium; 

wherein said digital image data is compressed in 
accordance with the MPEG system. 

19. An image data recording method comprising the steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and which has been 
corrected for aspect ratio and supplying digital audio 
data and subtitle data; 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital, image data and said subtitle 
information data so as to generate combined digital image 
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data ; 

multiplexing said combined digital image data and said 
digital audio data; and 

adding said digital aspect ratio identification data and 
image display format data as TOC data to the multiplexed 
data to form added data; and 

recording said added data on a recording medium. 

20. An image data recording method comprising the steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and which has been 
corrected for aspect ratio and supplying digital audio 
data and subtitle data;. 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and said subtitle 
information data so as to generate combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; 

adding said digital aspect ratio identification data and 
image display format data as TOC data to the multiplexed 
data to form added data; and 
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recording said added data on a recording medium; 

wherein said digital image data. is compressed in 
accordance with the MPEG system so as to include 
intraframe- coded (I) pictures / interframe forward- 
predictive- coded (P) pictures and interframe 
bidirectionally-predictive-coded (B) pictures. 

21. An image data recording method comprising the. steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and which has been 
corrected for aspect ratio and supplying digital audio 
data and subtitle data; 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and said subtitle 
information data so as to generate combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; 

adding said digital aspect ratio identification data and 
image display format data as TOC data to the multiplexed 
data to form added data; and 

recording said added data on a recording medium; 
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wherein said digital image data is compressed in 
accordance with the MPEG system so as to have a user data 
region immediately prior to a sequence header. 

22. An image data recording method comprising the steps 
of: 

supplying, digital image data which has been compressed 
in accordance with a MPEG system and which has been 
corrected for aspect ratio and supplying digital audio 
data and subtitle data; 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and said subtitle 
information data so as to generate combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; 

adding said digital aspect ratio identification data and 
image display format data as TOC data to the multiplexed 
data to form added data; and 

recording said added data on a recording medium; 

wherein said digital image data is compressed in 
accordance with. the MPEG system so as to be comprised of 
groups of pictures each having an associated group-of- 
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pictures header which is immediately preceded by a user 
data region. 

23 . An image data recording method comprising the steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and which has been 
corrected for aspect ratio and supplying digital audio 
data and subtitle data; 

generating subtitle information data in accordance with 
said subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and. said subtitle 
information data so as to generate combined digital image 
data;. 

multiplexing said combined digital image data and said 
digital audio data; 

adding said digital aspect ratio identification data and 
image display format data as TOC data to the multiplexed 
data to form added data; and 

recording said added data on a recording medium; 

wherein said digital image data is compressed in 
accordance with the MPEG system so as to include 
successive pictures having a picture header preceded by a 
user data region. 
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24. An image data recording method comprising the steps 
of: 

supplying digital image data which has been compressed in 
accordance with a MPEG system and which has been 
corrected for aspect ratio and supplying digital audio 
data and subtitle data; 

generating subtitle information data in accordance with 
said .subtitle data and generating digital aspect ratio 
identification data indicative of the correction of the 
aspect ratio of said digital image data; 

combining the digital image data and said subtitle 
information data so as to generatie combined digital image 
data; 

multiplexing said combined digital image data and said 
digital audio data; 

adding said digital aspect ratio identification data and 
image display format data as TOC data to the multiplexed 
data to form added data; and 

recording said added data on a recording medium;. 

wherein said identification data is data indicating that 
the mode in which said aspect ratio of the digital image 
data has been corrected is a squeeze mode or a letterbox 
mode . 

25. An apparatus for controlling displaying of an image, 
comprising: 
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means for supplying added data having digital aspect 
ratio identification data as table of contents (TOC) data 
and multiplexed data containing combined digital image 
data formed by combining according to image display 
format data subtitle information data and digital image 
data which has been compressed in accordance with a MPEG 
system and which has been corrected for aspect ratio and 
digital audio data; 

means for separating said digital image data, said 
subtitle information data, said digital audio data, and 
said digital aspect ratio identification data from said 
added data; 

encoder means for encoding said digital image data 
separated from said added data to an analog video signal 
and for inserting aspect ratio identification data on a 
predetermined line of said analog video signal; and 

means for controlling the aspect ratio of said image 
corresponding to the separated digital image data, as 
displayed by display means, in accordance with said 
digital aspect ratio identification data separated from 
said added data. 

26. An apparatus for displaying an image according to 
claim 25, further comprising: 

means for processing the separated digital image data in 
at least one of the horizontal and vertical directions of 
said display means; and wherein 

said means for controlling controls said means for 
processing according to said digital aspect ratio 
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identification data separated from said multiplexed data. 

27.. An image control method comprising the steps of: 

supplying added data having digital aspect ratio 
identification data as table of contents (TOC) data and 
multiplexed data containing combined digital image data 
formed by combining according to image display format 
data subtitle information data and digital image data 
which has been compressed in accordance with a MPEG 
system and which has been corrected for aspect ratio and 
digital audio data; 

separating said digital image data, said subtitle 
information data, said , digital audio data, and said 
digital aspect ratio identification data from said added 
data; 

encoding said digital image data separated from. said 
added data to an analog video signal and inserting aspect 
ratio identification data on a predetermined line of said 
analog video signal; and 

controlling the- aspect ratio of said image corresponding 
to the separated digital image data, as displayed by 
display means, in accordance with said digital aspect 
ratio identification data separated from said added data. 

28. An image display control method according to claim 
27, further comprising: 

processing the separated digital image data in at least 
one of the horizontal and. vertical directions of the 
displayed image; and 
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wherein said controlling of the aspect ratio is effected 
by control of said processing in accordance with said 
digital aspect ratio identification data separated from 
said multiplexed data. 

29. An apparatus for controlling displaying of an image, 
comprising: 

means for supplying added data having digital aspect 
ratio identification data as table of contents (TOC) data 
and multiplexed data containing combined digital image 
data formed by combining according to image display 
format data subtitle information data and digital image 
data which has been compressed in accordance with a MPEG 
system and which has been corrected for aspect ratio and 
digital audio data; 

means for separating said digital image data, said 
subtitle information data, said digital audio data, and 
said digital aspect ratio identification data from said 
added data; 

means for converting said digital image data separated 
from said added data into an image signal ; 

encoder means supplied with said image signal for 
encoding an image corresponding to said image signal to 
an analog video signal and for inserting aspect ratio 
identification data on a predetermined, line of said 
analog video signal; 

means for generating a correction signal corresponding to 
said digital aspect ratio identification data separated 
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from said added data; and 

means for superimposing said correction signal on said 
image signal supplied to display means so that the latter 
correspondingly determines a desired aspect ratio of the 
displayed image. 

30. An apparatus according to claim 29, further 
comprising: 

means for processing the separated digital image data in 
at least one of the horizontal and vertical, directions of 
said display means; 

controlling tneans having different states for controlling 
said means for processing according to said digital 
aspect ratio indent ificat ion data separated from said 
multiplexed data; and 

conversion means which converts said correction signal 
according to the state of control of said controlling 
means. 
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